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Abstract 



t^J- ' This paper presents a hierarchical game to model distributed joint power and channel allocation 

for multi-carrier energy efficient systems. A thorough analysis of the existence, uniqueness and 
characterization of the Stackelberg equilibrium is conducted. Interestingly, we show that, under some 
assumptions, introducing a certain degree of hierarchy in a multi-carrier system induces a natural 
coordination pattern where users have incentive to choose their transmitting carriers in such a way 
that they always transmit on orthogonal channels. Such an important result offers insights into how 
to design hierarchy in multi-carrier environments. Analytical results are provided to assess the gap 
between the non-cooperative game with synchronous decision makers and the proposed Stackelberg 

IT) 

game performances mainly in terms of spectrum utilization. We exemplify our general analysis 

in 

by investigating the possibility of applying such a model to cognitive radio network environment. 
Numerical examples illustrate and validate the theoretical results derived within the paper. 



I. Introduction 

Recent years have seen increasing efforts towards designing greener networking infras- 
tructure by improving energy efficiency of end-hosts, data centers, and the cloud operations. 
Multi-carrier transmission has become one of the hottest topics in wireless communications. 
After its adoption in digital audio and video broadcasting systems standards in the 1980s, 
this transmission technique appears now in several recent wireless communications systems 
standards such as LTE and WiMax. For all these reasons multi-carrier systems have the great 
potential in tackling one of the major challenge of future communication systems: how to 
guarantee the transition towards global substantiality, including economic issues and energy 
efficiency? 
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In this work, we consider hierarchy in multi-carrier wireless networks that can be modeled 
by a decentralized multiple access channel. The network is said to be decentralized in the 
sense that the receiver does not dictate to the users their transmit power levels. Hence, 
each user can choose freely his power control policy in order to selfishly maximize a 
certain individual performance criterion, called utility (or payoff) in the context of game 
theoretic studies. Unlike many works concerning this problem, the chosen users' utility is 
not the transmission rate (e.g. JT), fl2l) but the energy-efficiency of their communications. 
Indeed, motivated by the facts that mobile terminals have a limited battery life and not 
the transmission rate. In the literature, energy-efficient power control game has been first 
proposed by Goodman et al. in Q for flat fading channels and recently re-used by [|9]| for 
multi-carrier CDMA (code division multiple access) systems and linear receivers. 

The multi-dimensional nature of users' strategies and the non-quasi-concavity of the energy 
efficiency function make the multi-carrier problem much more challenging than the single- 
carrier or throughput-based-utility case. In this work, we consider a hierarchical multiple- 
access multi-carrier system in which both leaders and followers wish to selfishly maximize 
their utility by means of adequately choosing their transmit powers over the carriers. A main 
challenge of applying the idea of hierarchical games in the multi-carrier context is that the 
followers should observe the leaders' decisions and be able to coordinate their actions in order 
to transmit on vacant carriers. Following the above trend, we explore a Stackelberg energy 
efficiency game framework and analyze how users behave in the presence of hierarchy. 

As mentioned in the Nash equilibrium (NE) in such games can be very energy in- 
efficient. In the same context, proposed, for multiple access channels with flat fading 
links and single-user decoding, a pricing mechanism to obtain improvements in the users' 
utilities with respect to the case with no pricing. Note that the Stackelberg formulation arises 
naturally in some context of practical interests. For example, this hierarchy is naturally present 
in contexts where there are primary (licensed) users and secondary (unlicensed) users who 
can sense their environment because there are equipped with a cognitive radio IfTOl . It is also 
natural if the users access to the medium in an asynchronous manner. Note that there have 
been many works on Stackelberg games, even in the context of cognitive radio [11], but they 
do not consider energy-efficiency for the individual utility as defined in Q, flU, IL21- They 
rather consider transmission rate-type utilities (see e.g. fl2l, lfT3l . EH). 

In this paper, we introduce the hierarchy concept in multi-carrier energy efficient systems. 
Specifically, we consider different hierarchical levels among the users, i.e., some users' 
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decision priority is higher/lower than the others. It is easy to see that this hierarchy concept can 
be directly applied to the cognitive radio networks, where primary users can act in the most 
efficient way, taking into account the behaviors and impacts of secondary users. In Section 
IVIIIl we will exemplify our general analysis by investigating the possibility of applying such 
a model to cognitive radio networks. As we will see, it is shown in this paper that there 
exists a natural coordination between the users where, at the Stackelberg equilibrium, only 
one user transmits on one given carrier. Such an accurate system modeling presents a key to 
understand the actual benefits brought by the multi-carrier energy efficient system capabilities. 

The original contributions of this paper are threefold: 

• Introducing hierarchy concept in power control game for energy efficient multi-carrier 
systems, 

• Characterizing completely and analytically the Stackelberg equilibria and compare the 
results obtained in the proposed hierarchical game with those obtained in the non- 
cooperative game in (5]|, 

• Our main result is that we always obtain an equilibrium (contrary to the work addressed 
in [|9]|) where, for the most general cases, users transmit on distinct carriers delivering a 
binary channel assignment. For implementation purposes in a cognitive radio network, 
the follower (or secondary user) has only to reliably sense the spectral environment (and 
not the leader's transmit power as it is the case in the single carrier context in [6]) and 
then decides to transmit only on the best carrier left idle by the leader. 

The remainder of the paper is organized as follows. The general system model is provided 
in Sec. HH Sec. [III] defines the energy efficiency framework and Sec. [IV] reviews the non- 
cooperative game and presents the hierarchical game problem. Then, in Sec.|V]we characterize 
the Stackelberg equilibrium. To gain more understanding on the addressed issues we focus in 
Sec. |VI]on the two-user case study, for which we derive the Stackelberg equilibria depending 
on the channel gains of users. The performance analysis in terms of spectrum use and 
especially the property of spectrum coordination between users is discussed in Sec. IVIII 
Sec. IVIIIl provides a use case study in a cognitive radio network for the proposed scheme. 
Sec. [IX] provide numerical results to illustrate and validate the theoretical results derived in 
the previous sections. Additional comments and conclusions are provided in Sec. |Xj 
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II. System Model 

Consider a decentralized multiple access channel with an arbitrary number of users, which 
is denoted by N. We assume that the users transmit their data over block Rayleigh flat 
fading channels and that the receiver knows on each block the channel gains (coherent 
communication assumption) whereas each transmitter has only access to the knowledge of 
his own channel. The latter assumption is realistic in systems where the uplink-downlink 
channel reciprocity is valid or if a reliable feedback mechanism is available. The equivalent 
baseband signal received by the base station can be written as 

N 

y k = J2 h n X n + Z n, fork = l,...,K (1) 

n=l 

where stands for the block fading process of user n on the sub-band k, x k n is the signal 
transmitted by user n on the sub-band k and z k is the additive Gaussian noise at the fcth sub- 
band. We denote by g n = \h n \ 2 the fading channel gain which is assumed to stay constant 
over each block fading length (i.e. coherent communication). The assumption of coherent 
reception is reasonable if the fading is slow in the sense that the receiver is able to track the 
channel variations. We statistically model the channel gains g n to be i.i.d distributed over the 
N Rayleigh fading coefficients and E {<7*} = 1 for n = 1, N. The signal transmitted x^ 
can be further written as x k n = \fp\ s n where p k and s k are the transmit power and data of 
user n. We thus have E {|x^| 2 } = p k . The additive Gaussian noise z n at the receiver is i.i.d 
circularly symmetric and z n ~ CJ\f(0, a 2 ) for n = 1, N. For any user n E {1, N} the 
received signal-to-noise plus interference ratio (SINR) is expressed as 

l k n = : =^- (2) 

m=l 

It follows from the above SINR expression that the strategy chosen by a user affects the 
performance of other users in the network through multiple-access interference. 

III. Network energy-efficiency analysis 

Our system model is based on the seminal paper Q that defines the energy efficiency 
framework. To pose the power control problem as a non-cooperative game, we first need 
to define a utility function suitable for data applications. SINR is a critical parameter for 
the quality of service (QoS) of the signal transmission, as it directly determines the bit 
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error rate, which is closely related to the data throughput (average rate of successful packet 
delivery). In brief, when SINR is very low, data transmission results in massive errors and 
the throughput tends to 0; when SINR is very high, data transmission becomes error-free and 
the throughput grows asymptotically to a constant. However, achieving a high SINR level 
requires the user terminal to transmit at a high power, which in turn results in low battery 
life. This phenomenon can be concisely captured by an increasing, continuous and S-shaped 
"efficiency" function /(■), which measures the packet success rate. Therefore, the throughput 
of user n over carrier k can be expressed as 

T n = R n • /( 7 *) (3) 

where R n and 7^ are respectively the transmission rate and the SINR of user n over carrier 
k. We also require that to ensure that u n = when p n = 0. On the other hand, increasing the 
transmit power clearly favors the packet success rate and therefore the throughput. However, 
as the packet success rate tends to one, further increasing the power can lead to marginal 
gains in terms of throughput regarding the amount of extra power used. The following utility 
function allows one to measure the corresponding tradeoff between the transmission benefit 
(totoal throughput over the K carriers) and cost (total power over the K carriers): 

u n (pi, ...,p N ) = j=± . (4) 

k=l 

The utility function u n that has units of bits per joule perfectly captures the tradeoff between 
throughput and battery life and is particularly suitable for applications where energy efficiency 
is crucial. It should be noted that the throughput in © could be replaced with any increasing 
concave function as long as we make sure that u n (0, . . . , 0) = 0. It can be shown that for 
a sigmoidal efficiency function, the utility function in © is a quasi-concave function of 
the user's transmit power (4j|. This is also true if the throughput in ([3]) is replaced with an 
increasing concave function of 7*. 

IV. The game theoretic formulation 

A. The non-cooperative game problem 

An important solution concept of the game under consideration is the Nash equilibrium 
(NE) 0, which is a fundamental concept in non-cooperative strategic games. It is a vector 
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of strategies (or actions in our case) p = , . . . ,p N , one for each player, such that 
no player has incentive to unilaterally change his strategy, i.e., u n (p^ E ,\) NE ) > u n (p n , p^f) 
for all action p n ^ p^ E \ where the — n subscript on vector p stands for "except user n", 
i.e., p n = {pi, . . . ,p n -i,p n+ i, . . . ,pn}- In the case of hierarchical single-carrier game, it 
has been shown that there exists a unique Stackelberg equilibrium O. In Q and authors 
showed that, under certain conditions, the NE of the game with utility © exists. 

From now on, we will only consider the case of two-users (one leader and one follower) 
subject to mutual interference. Although its simplicity, this scheme allows us to address the 
problem of hierarchically allocating transmit power in multi-carrier systems and gain insights 
into how to design power control strategies in a multi-carrier environment. 

B. The hierarchical game formulation 

There are many motivations for studying wireless networks with hierarchical structures, 
but the most important ones are to improve the network efficiency and modeling aspect. 
The Stackelberg game has been firstly proposed in economic problem and also in biology 
for modeling optimal behaviors against nature [8]. It is in fact a mechanism for wireless 
networks in which some wireless nodes are equipped with cognitive sensors and can sense 
the activities of others, but some other nodes cannot. This is also a natural setting for cognitive 
wireless networks, where users have access to the medium in an asynchronous manner. For 
example, primary (licensed) users have priority to access the medium and then secondary 
(unlicensed) users access the medium after sensing the environment (see Sec. I Villi for more 
details). At the core lies the idea that the utility of the leader obtained at the Stackelberg 
equilibrium is better than his utility obtained at the Nash equilibrium when the two users 
play simultaneously. It has been proved in [0 that this result is also true for the follower. The 
goal is then to find a Stackelberg equilibrium in this two-step game. It is noteworthy that if 
there exists a Nash equilibrium in a game, there exists at most one Stackelberg equilibrium. 
In this work, we consider a Stackelberg game framework in which the leader decides first his 
power allocation vector p x = (p\, . . . ,pf) and based on this value, the follower will adapt 
his power allocation vector p 2 = (pi, . . . ,pf\)- Throughout the paper we will denote by U c 
the utility function where subscript c is F for the follower and L for the leader. 
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Definition 1. (Stackelberg equilibrium J: A vector of actions p = (pi, p 2 ) = (p\, . . . , pf , p 2 , . . . , p%) 
is called Stackelberg equilibrium (SE) if and only if: 



where 



pi = argmax£/z,(pi,p 2 (pi)), 
pi 



Vpi, P 2 (pi) = argmaxE/>(pi,p a ), 

P2 



and p 2 = p 2 (pi). 

A Stackelberg equilibrium can be determined using a bi-level approach. First, given the 
action of the leader, we compute the best-response function of the follower (the function 
p 2 (-))> i.e. the action of the follower which maximizes his utility given the action of the 
leader. We characterize this best-response function by using a result from (9). Define the 
effective channel gain as the ratio between the SINR and the transmission power for the 
follower over the k th carrier. This depends on the power used by the leader on carrier k 
through the following expression: 

Vke {!,...,*}, kin 1 ;) (A 



p\ er 2 + g\p\ 

V. Characterization of the Stackelberg equilibrium 

We first determine the best-response function of the follower depending on the action 
of the leader. This result comes directly from Proposition 1 of @. For making this paper 
sufficiently self-contained, we review here the latter proposition. 

A. The follower's power allocation vector 

Proposition 1. Given the power allocation vector pi of the leader, the best-response of the 
follower is given by 

-k, X k > f° r k = L 2{Pl), 

P2(Pl) = { 92 (5) 

I 0, for all k ^ L 2 (pi) 

with L 2 (pi) = argmax/i^Pi) and 7* is the unique (positive) solution of the first order 

k 

equation 

xf'(x) = f{x) (6) 

Equation © has a unique solution if the efficiency function /(■) is sigmoidal 01, and we 
will use this assumption throughout our paper. The last proposition says that the best-response 



s 



of the follower is to use only one carrier, the one such that the effective channel gain is the 
best. 

B. The leader's power allocation vector 

Let us now study the optimal allocation for the leader knowing the best-response of the 
follower. Let k denote the "best" carrier of the leader, i.e. k = axgmaxg*. A necessary and 
sufficient condition on the follower' channel gains such that the best-response function of 
the follower is to transmit over a different carrier than the leader is given in the following 
proposition. 

Proposition 2. At the Stackelberg equilibrium, if the leader transmits over only one carrier, 
the follower transmits over another carrier if and only if: 

g> 2 1 + 7* 

where 7* is the unique (positive) solution of the first order Equation ©. 

For the clarity of the exposition, proofs are given in the Appendix. This condition implies 
that all the carriers are almost homogeneous, i.e. a given user experiences approximately 
the same radio conditions over his carriers. Denote that this is typically the case in wireless 
systems 031. Given this proposition, we are able to determine the best action of the leader, 
and then to deduce the Stackelberg equilibrium. The following proposition gives the optimal 
power control of the leader knowing the best-response of the follower at the Stackelberg 
equilibrium. Typically, it is proven that the optimal allocation of the leader is also to use 
only one carrier. 

Proposition 3. (First main result): At the Stackelberg equilibrium, when the channel gains 
of the follower satisfy 0, the power allocation vector p x for which the leader's utility is 
maximized is unique and is given by 

— it, for k = k, 
ft = I 9$ I (8) 

I 0, for all k ^ k 

where 7* is the unique (positive) solution of the first order Equation ©. 

Proposition [3] says that the utility of leader is maximized when it transmits only over its 
best carrier. Accordingly, we observe that the carrier which do not contribute enough energy 
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efficiency to outweigh the interference degradation caused by the follower's transmission is 
switched "off'. In order to show this important result we will proceed through the following 
propositions and analysis. Notice that, although we limit our analysis to the two-carrier case, 
we emphasize that this is not a restriction of the results presented throughout the paper. 



VI. The case of two carriers 

In this section, we provide a thorough analysis of the existence, uniqueness and character- 
ization of the Stackelberg equilibrium for all different cases illustrated in |3] This is done for 
a two carrier system, i.e. K = 2, in order to provide insights to best understand the actual 
benefits brought by hierarchy compared to results obtained in the non-cooperative framework 
in 10. Note that, in this case, the condition described in Equation © becomes: 

— - - < ^| < 1 + 7*- (9) 

1 + 7* g£ 

The power allocation vector of the leader is pi = (p\,Px). Proposition Q] claims that there 
are two regions which depend on the leader power allocation such that the best-response of 
the follower is different. Below we define the two regions: 



a={(pwm<p\ 9 M+^ 2{j K^ 1 } 



9x92 ghl 



and 



B = {{plp\M>p\ 9 M + a^A r ^}. 

9\92 9\92 

In region A, we have that h\>h\. Given Proposition [TJ we have that the power allocation 
vector of the follower in this region is given by 

p A WH(0 , iV±jM) ). 

92 

In region B, we have that h\ < h\. Similarly, given Proposition [H we have that the power 
allocation vector of the follower in this region is given by 

P?(p}) = ( 7>2 t gM) ,o). 

92 

Based on the above equations, we can compute the explicit expression of the leader's SINR 
on each carrier for both regions, namely 



7* 



^f 1 , in region A, 
in region B 



o-2(l+7*)+ 7 * s ipi> 
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2 = J ^(i+r)+rgiPV 

rr2 5 



in region A, 



in region B 



It follows that the utility function of the leader given by Equation © for region A can be 
expressed as 

Pi i* Pi 

Pi + Pi 

Similarly, in region 5, the leader' utility function is 

Rif( 2nA P l . i + 

1J \ it 2 (l+7 )+7 SiPj ' J v o" ' 



C/f(pl,P?) 



Pi + p? 

Without loss of generality, the analysis is given only for region A. Similar approach can be 
adopted for region B. We first derive the utility of the leader U^(p\,pf) w.r.t p\. We obtain 

dp\ {pI+pD 2 

Now, let us compute the derivative of the leader's utility Uf on the region A w.r.t p\ . We 
have 

dUtipUl) _ R / , (7i 2 )-^-(Pl+P?)-[/(7i 1 ) + /(7i 2 )] 
dp\ 1 ip\+p\) 2 

where g| = ali^p^A^h^A ^ Knowing that a 2 + p^ 2 2 = and after some 

"Pi ct2 +7*(°" 2 +Pi9i) *~ 1 7 7i 



simple simplifications, we obtain that ^ 



a 2 (l+7*) 



We shall look for a couple (p},p 2 ) such that ^r(pi,Pi) = ^r(pi,Pi) = 0. It follows 
from the above results that a couple (p\,pf) is solution of the following system 



fW^M+pl) = f(il) + fdl) 

fW 9 -%=^Q^ ip\+p 2 i) =f(il) + fd!) 



with 7l x = # and 7l 2 = 2n jM 

The solutions of the above system are given by 

9i 



A = ^ (10) 
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and 

g{ (1 - 7*7 X 2 ) 

Next, we shall show that, under some given assumptions, p\ is equal to zero at the Stackelberg 
equilibrium as addressed by Prop. [3j 

Note that if 7^ is not in ]0, this game has still a Stackelberg equilibrium if the transmit 
power of the leader is limited i.e. p\ E [0, P max \. Therefore, if the leader has not enough 
power to reach the SINR 7^ he will transmit at his maximum power, which is also an 
equilibrium. In this paper, for sake of clarity, we will only consider the most interesting (and 
non-trivial) regime where the transmit powers are less than their maximal levels but all the 
results provided in this paper easily extend to the case of finite powers. In this regime, even 
if a user has an infinite transmit power he will not necessarily use all of it. 

We have seen in Prop. \T\ that the best-response function of the follower depends on the 
allocation powers of the leader and the channel gains. In this setting, we will present in 
the next proposition under which conditions the leader transmits on a given carrier at the 
stackelberg equilibrium. Specifically, we will show that, at extreme cases (i.e., when a given 
user experiences very different channel gains on his two carriers), the two players may choose 
to transmit on the same carrier at the Stackelberg equilibrium. In this case, both users prefer 
to transmit on the same carrier as this contributes enough energy efficiency to outweigh the 
interference degradation caused by the mutual transmission. 

A. Extreme Cases 

In a Stackelberg game, if the leader decides to play his Nash action, then the follower 
plays the Nash action too, as it is the best-response to the Nash action itself. Then, depending 

fll 

on the ratio ^ of the leader channel gains, it could be interesting for him to transmit over 
the same channel than the follower. 

Proposition 4. In region A (resp. B), at the Stackelberg equilibrium, the leader and the 
follower transmit on the first (resp. second) carrier if: 

4>t^T> iresp. 4< 1 -7*), fame {1,2}. 

9 l n 1 - 7 9n 

1 

In the extreme case of region A (^ > 1/(1 — 7*)), the leader decides to transmit on the 
same carrier (second one here) as the second carrier is very good compared to the first one. 
In the extreme case of region B < 1 — 7*), the channel gain is very bad on the second 

9i 
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carrier with respect to the one on the first carrier and then both users choose to transmit on 
the first carrier. Note that, in this case, the follower and the leader transmit over the same 
carrier using an optimal power allocation given by the Stackelberg model proposed in (61 . 
This extreme case on the channel gains where the two players transmit over the same channel 
is not realistic. Indeed, it is usually assumed that channel gains on different carriers for a 
given user are correlated with a correlation factor close to 1, i.e. the different carriers are 
approximately the same for a given user at a certain time. 

B. Non-extreme case 

From now on, we assume that different carriers for the leader or the follower are not in 
these extreme conditions, namely 



i-7*<4<r^ or 1 -^ < 4<r^T' (12) 

gf 1 - 7* 02 1 - 7 

with 7* is the unique (positive) solution of the first order Equation ©. For the case of 
Rayleigh fading channels, the probability of being in the non-extreme case is given by 

Pr {non-extreme case} = 1 — ^(7*) (13) 
where ^(7*) stands for the probability to be in the extreme case, namely 



9 l>-L\. Pr { 9 l>^— \ +P ri 9 l> l- A .p T {& 
S?-1-7*J Ul - 1-7*1 IS?" J Ul 



00 poo p 00 7 )y 

/ e- {x+v ^dxdy + e- [x+y) dxdy 
J v Jo Jo 



(l-T*) 



* i \ 2 

7* - 1 N 



00 /.(l-7*)t/ 



= 2 • , 

v7* ^ 2 , 

Fig. [2] depicts the probability of being in the non-extreme case where we assume that the processing gain is 
sufficiently large so that when the two users transmit over the same channel, the SINR 7* can be achieved 
(i.e., 7* < 1). In particular, it is shown that the probability of being in the non-extreme case is always more 
than 0.5. As the SINR 7* increases, the extreme region shrinks resulting in an increase of the non-extreme 
case probability. At 7* = 1, the non-extreme case probability reaches 1 since the extreme region completely 
disappear. We will show in next that this probability gives in fact the probability that users transmit on distinct 
carriers. 

We shall now look at the problem of the existence and the uniqueness of the vector of transmit power levels 
for the leader. A solution to these issues is stated through the following propositions. 

Proposition 5. (Existence of a SE): At the Stackelberg equilibrium in region A (resp. region B), there exists 
a power allocation vector for the leader where p\ — (resp. p\ = 0). 
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Prop. |5] insures that there exists a power allocation vector for the leader in region A where p\ = 0. However, 
there could be a solution of system (S) such that pi > 0. In the next proposition, we will show that p\ = 
is the unique solution of System (S). A simple way to do it is to prove that all the other solutions of System 
(S) are outside of region A. The uniqueness of the leader's action at the SE insured by the geometrical and 
topological properties of the utility function and the strategy sets of the users, over which the maximization is 
performed. 

Proposition 6. (Uniqueness of the leader's power at the SE): In region A (resp. region B), the Stackelberg 
equilibrium for which the leader's utility function is maximized is obtained when p\ = (resp. p\ = 0). 

Now, we come back to the main result. Combining the above results, we obtain that the utility of the leader 
within region A is maximized when p\ = 0, yielding 



i i 
r> r, 'i ' 



max U£ (p{ , pf ) = max U? (jp\ , 0) = max M^lI 
pi .pi pi Pi Pi 

which means that the maximum utility over region A is given by 

We now shall determine the power pi depending on the channel gains of the follower. 

Proposition 7. The utility of the leader over region A is maximized when the leader transmits with the power 
p\ defined by: 

{ ° 2 1* ;f 92 > _J_ 

P{=\ fi'_ 1 * 14 7" (14) 

- 2 9 , otherwise, 

where 7* is the unique (positive) solution of the first order equation ((S]). 

Within region B, we have the same analysis which yields that 

maxUEiplpl) = maxt/f (0,p?) = max ^^ . 
Pi.Pi Pi Pi Pi 

yielding that the maximum utility within region B is given by 

uE = uE(o,p1). 

We have the similar result for the utility of the leader over region B. 

Proposition 8. The utility of the leader over region B is maximized when the leader transmits with the power 
p\ defined by: 

er 2 7* „2 

p\ = { 91 92 (15) 

7 ? i 9 ' 2 , otherwise, 

9192 ' ' 



where 7* is the unique (positive) solution of the first order equation ((S]). 
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Using the two previous propositions, we get the first main result in Prop. [3] Indeed, if the channel gains of 
the followers satisfy condition O the optimization of the leader's utility becomes 

pIpI { UE, if g{ < g\. 

as / is a strictly increasing function. 



VII. Spectrum coordination 

Prop. Q] and Prop. [3] suggest that both the follower and the leader transmit on only one carrier depending 
on their channel gains. In the next proposition we will show that introducing a certain degree of hierarchy 
in a multi-carrier system induces a natural coordination pattern where users have incentive to choose their 
transmitting carriers in such a way that they always transmit on orthogonal channels. 

Proposition 9. (Second main result): In the non-extreme case, introducing hierarchy between users in a multi- 
carrier energy efficient power control game "pushes" users to coordinate their actions in such a way that they 
always transmit on different carriers. 

To show this important result, we will determine the Stackelberg equilibria of the game depending on the 
channel gains given conditions derived in the previous section. As far as the proposed hierarchical model is 
concerned, the SE can be computed by considering the two following cases: 

A. Homogeneous Case 

In the homogeneous case, the follower experiences approximately the same radio conditions over his two 
carriers (i.e., channel gains satisfy condition (O). Then the following holds about the Stackelberg equilibrium: 

. (a) If 4 < 1 and 4 < 1 + 7* then 

Si 92 

p 2 (o,-f) = (-^So), 

9i 92 

^ 2 ^ 1 

because h\ = zrrji: ,\ and h\ = The Stackelberg equilibrium is then given by 



'2 - <r 2 (l+7*) 

V 9i 92 
(b) If ft > 1 and ft > ^ then 

o-V a 2 j* 

9i 92 

^ 1 ^2 

because h\ = ^rrfi: ,\ and h 2 , = Then the Stackelberg equilibrium is 



1 .2 1 on _ ( I** 2 n n 7** 2 



{Pl,Pl,P2,P2) = —,0,0, 2 

9i 92 
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B. Heterogeneous Case 

In the heterogeneous case, condition (0 is no more satisfied. The following holds about the SE: 
• (a) If % > 1 + 7* (i.e., the follower experiences deep fade on his second carrier compared to his first 
carrier), 

- (i) if % < 1 then the Stackelberg equilibrium is 

9i 

,*_2 -,* /T 2 



(* 2 * 2 \ 
0, — — t-,0 ) 
5i 92 1 



- (ii) else, % > 1, the power allocation vector of the leader at the Stackelberg equilibrium is 

9i 



= < y gut 

where condition ( TToT l is 



0, ] otherwise. 

si ■ 



4 > m.£±. ,i6, 

The follower transmits on the carrier which is left idle by the leader if condition ( [ToT l is not satisfied. 
In this case 



«•« - (if- ) 



If condition (TT~6T > is satisfied, we have the following best-response for the follower: 

P2 ' °) = 1 ( — 2— ' °) OR (°>— 2~) 

9 m I 52 52 

because the effective channel gains are equal for both carriers, i.e., h\ = h% = %. Then the best- 
response is not unique in this case and the two players can use the same carrier, the first one here. 
As the follower plays after observing the action of the leader, the follower can decide, for optimizing 
spectrum utilization, to transmit over the carrier left idle by the leader. Moreover, the follower's power 
is inversely proportional to the channel gain over the second carrier. Then, it is more convenient for 
him to transmit over this second carrier. 

(b) If || < yq^p (i.e., the follower experiences deep fade on his first carrier compared to his second 

carrier), we have the similar results: 

- (i) if |jf > 1 then the Stackelberg equilibrium is 

i i 2 i 2\ f 7* " 2 7*cr 2 

lPl,Pl,P2)P2j = —,0,0, — 

V 9x 52 

- (ii) else, % < 1, the power control vector of the leader at the Stackelberg equilibrium is 

9- 



w>%) = \ > 2 . r 2 



o / (g2 ~ g2) ) if (17). 



otherwise. 
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where condition (fTTT i is 



, „ f( (9 2 -92) ) 



%< 7 / A/ - (17) 



g\ f{r) M^£i) 

92 

The follower transmits on the carrier which is left idle by the leader if condition ( fTTI i is not satisfied. 
In this case 

(M) = (o,^). 

If condition dTvT > is satisfied, we have the following best-response for the follower: 

P2(0, n ) = \ (0, — —J OR — — ,0U, 

9192 I 52 52 J 

because the effective channel gains are equal for both carriers, i.e., h\ = /i| = %. Then the best- 
response is not unique in this case and the two players can use the same carrier, the second one here. 
In this particular case, the follower can decide to transmit over the first carrier in order to optimize 
the spectrum utilization. Again, as the follower's power is inversely proportional to the channel gain 
on the first carrier, it is more convenient for him to transmit over this first carrier. 
A global overview of the occupation of the carriers at the Stackelberg equilibrium, as function of the ratios 
% and % is depicted in Figure (01. One of the main contribution of our paper is that we have proved the 

92 9i 

existence of an equilibrium when a mobile can observe the action of the other before deciding his own action, 
whatever the channel gains are. This result is not true in the case when the two players play a Nash equilibrium 
(see |3). 

VIII. Application to Cognitive Radio Networks 

Stackelberg game formulation can be seen as one possible approach for modeling wireless networks where 
some wireless devices are equipped with cognitive sensors and can thus sense the activities of others, but some 
other nodes cannot. This is also a natural setting for cognitive wireless networks, where users have access to the 
medium in an asynchronous manner. For example, primary users (leaders) have priority to access the medium 
and then secondary users (followers) access the medium after sensing the environment. At the core lies the idea 
that spectrum utilization can be improved by allowing cognitive users to access a spectrum hole unoccupied 
by the primary user. 

In the current hierarchical model, Prop. [9] claims that as long as we are not in the extreme case, a cognitive 
user transmits over a certain frequency band in order to reach SINR 7* (solution of the unique (positive) 
solution of the first order Equation (0) only when no primary user does. This enables public access to the 
new spectral ranges without sacrificing the transmission quality of the actual license owners. Typically, the 
primary user comes first in the system, estimates his channel gains (g\) over all carriers and adapts his transmit 
power using Prop. [3] depending on the region where channel gains are as illustrated in Fig. [3] The second user 
comes in the system randomly, for instance in a Poisson process manner and estimates his channel links (g%) 
over all carriers. Such an assumption could be further justified by the fact that in an asynchronous context, the 
probability that two users decide to transmit at the same moment is negligible as the number of users is limited. 
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Thus, within this setting, the primary user is assumed to be oblivious to the presence of the secondary user. 
The leader communicates with his BS while the cognitive user listen to the wireless channel and determines 
which part of the spectrum is unused by the leader. Then the secondary user adapts his transmit power to fill 
detected voids in the spectrum using Prop. [T]in an overlay fashion. Accordingly, in order to determine which 
part of the spectrum is unused, cognitive user has just to detect the received signal from the primary user. Many 
techniques were developed in order to detect the holes in the spectrum band. Focusing on each narrow band, 
existing spectrum sensing techniques such as energy detection iTTSll and feature detection [17j are particularly 
suitable for such an overlay system. 

IX. Simulation Results 

To go further with the analysis, we resort to numerical examples. We consider the energy efficiency function 
proposed in most papers dealing with power allocation games that is f(x) = (1 — e~ x ) M , where M = 100 
is the block length in bits. In Figure [3] we consider static channel gains g\ = 0.4, g\ = 0.3, g\ = 0.6 and 
g\ = 0.5. The noise signal variance is a 2 = 0.001. We observe from Fig.[3]that the power allocation decision of 
the leader is to use one carrier, the first one here. Considering those variables, the unique solution of Equation 
© is 7* = 6.4. We have % = 5/6 which is in the interval [ j^zi , 1 + 7*]- Then, we are in the homogeneous 

2 

case. We further have % = 0.75 < 1, which means that the Stackelberg equilibrium is given by dVH-Al b) 
where the leader transmits on the first carrier and the follower on the second carrier. We observe on Figure [3] 
that the Stackelberg equilibrium obtained theoretically is correct, namely 

{pl Pi p\, pf) ^(0.016,0,0,0.0128) 
In Figure [4] we change the channel gain of the second carrier for the follower, i.e. g\ — 3.8. We are then 

2 2 

in the heterogeneous case because |r < . Moreover, as |r < 1, the Stackelberg equilibrium is given by 
(IVII-Bl a-ii) where condition ( TTol l is satisfied. We are thus in the case where for both users the first carrier is 
the best one. In particular, the leader transmits on the first carrier with power p\ ~ 0.0175. If we consider a 
channel gain g\ — 4, then the Stackelberg equilibrium is still given by dVII-Bl a-ii) where condition ( fl~6t is no 
more satisfied. The leader decides then to use the other carrier (the second one) with the power p\ ~ 0.0213 
and the follower uses the first carrier with the power p\ = 0.0016. In this case, the Stackelberg equilibrium is 

(pi,P?,P2>p!) ^(0,0.0213,0.016,0) 

X. Conclusion 

We have analyzed in this paper the impact of hierarchically allocating transmit power in energy-efficient 
multi-carrier systems. By hierarchical we mean that some transmitters are able to sense their environment before 
taking their decisions on the power allocation vector where others cannot. This framework is particularly suitable 
for an overlay system like spectrum pooling lfl6l or cognitive radio networks iflOl . Interestingly, contrary to 
results in we have first obtained the existence of an equilibrium whatever the channel gains of each player 
are. Second, we have obtained a spectrum coordination property in the case of homogeneous channel gains 
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(which is generally assumed in realistic scenarios), in which at the equilibrium, followers operate on the best 
idle carrier of the leader. Indeed, we have proved that there is only one case where the two players transmit on 
the same carrier; when for both players one carrier has a very good channel gain compared to other carriers. 
Finally, one important task in the context of cognitive radio networks, the proposed model leads that, even if 
we are working on a power control mechanism, the follower (or the cognitive user) has only to has only to 
reliably detect the carrier used by the leader (or the primary user) and not the leader's transmit power as it 
is the case in the single carrier context in H). Such an accurate and efficient modeling of the power control 
game problem is a key to understand the actual benefits brought by multi-carrier energy efficient systems. 
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i-y* 



[F,L] [FL,.] 




1/{1-V* 



Fig. 1. Stackelberg equilibrium regions for the case of two users and two carriers. The point [F, L] means that the leader 
transmits over the second carrier and the follower over the first one. 




Fig. 2. The probability of being in the non-extreme case considering Rayleigh fading channels. 



Fig. 3. Leader's utility with g\ = 0.6. The leader transmits on the first carrier and the follower on the second carrier. 




Fig. 4. Leader's utility with g| = 3.8. Here the first carrier is the best one for the leader. 
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Appendix 

A. Proof of Proposition [2] 

Proof: Assume that the leader transmits over one channel, says channel i. Then, the allocation vector of 
the leader is pi = (0, . . . ,p\, . . . , 0). 

2 * 

• If the follower does not transmit on the carrier i, i.e. ^(pi) = J / i. Then, we have that p\ = 
yielding that h 3 2 — > h\ — o . 2 (^ 7 »- ) which is equivalent to: 

9± > 1 



92 1 + 7* 

where 7* is the unique (positive) solution of the first order Equation ©. Then, we have proved that the 
condition (0 is sufficient. 

If condition is satisfied it means that there exists a carrier j such that g\ > rrf^) • Then, we assume 
that the follower transmits over i, which means that: 

K > H = 4. 

2 a 2 

Suppose that the two players transmit over channel i and the power used by the leader at the Stackelberg 

equilibrium is higher compared to the case when a user is alone on a carrier (6). Then, the power p\ 

2 * 

used by the leader is higher than ^—j—. This implies that the effective channel gain of the follower on the 

9l 



carrier 1 is: 



ti = 92 92 jh = p 

2 <T 2 +g\p{ (T 2 (l+7*) a 2 ' 2 ' 

But this is in contradiction with the assumption that the follower transmits over channel i, then the follower 

does not transmit over channel i, the one chosen by the leader. We then have proved the sufficient condition. 



B. Proof of Proposition |?] 

Proof: We prove this proposition considering only the area A as it is the same idea for the other area. It 
is preferable for the leader to transmit over the same carrier than the follower, the second one in this area, if 
and only if the utility at the Stackelberg equilibrium when the leader and the follower transmit on the second 
carrier is higher than the utility of the leader when he is alone to transmit over the first carrier. 

The maximum utility for the leader, in the region A, when he is alone to transmit over the first carrier is 
given by: 

ttNSe _ fli/(7*) „i 

U L — h~* 9l- 



When both users transmit over the second carrier and the leader plays the Nash action, i.e. pf = 



2 _ <T 7 



S?(l-7*)' 



the best-response of the follower is to choose the power pi, = g2 ^ 1 2 7 ») ■ This Nash equilibrium exists if the 
target SINR 7* < 1. Then, the leader's utility at the Nash equilibrium is: 

TT NE _ #l/(7*)(l-7*) 2 
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This result is true if the Nash action of the leader (p\,pf) = (0, p^yr^y) is inside the region A. This is true 
if and only if: 



ff?(l"7*) " 9l9l ' 
which is equivalent to: 

& < 1 _ ~* 

Thus, the leader's utility at the Nash equilibrium is better than the utility if he transmits on the second carrier 
if and only if: 

Then, if p < 1 - 7* and || < 1 - 7*, we have that U% E > U^ SE . But, the utility of the leader at a 
Stackelberg equilibrium is, by definition, better or equal than the utility of the same player if he plays the Nash 
action (the best-reponse of the follower if the leader plays the Nash is the Nash). Then, if |£ < 1 — 7* and 
% < 1 — 7* the utility of the leader at the Stackelberg equilibrium when the two players transmit over the 
second carrier, is better than the utility of the leader if he transmits alone on the first carrier. 

We have there similar analysis with the region B, in which the follower transmits over the first carrier. Over 
this region, the two players transmit over the first carrier if and only if the following conditions are satisfied: 

si 1 , 92 1 

*T > 1 *> and -\ > 1 * ■ 

91 1-7 S2 1 - 7* 



C. Proof of Proposition \5\ 

Proof: In the region A, we have the following relation between the powers of the leader: 



2 < 10102 1 2 (g|-g2) 
Pi Pi o 1 ' 2 1 

9i9\ 9i9\ 



1 g\a% 



which means that for all p\ > 0, the leader's power on the second carrier p\ is in the interval [0,p} g ^ 



cr 2 g-ig 9 i 2 ]■ Therefore, our problem boils down to show that, for a fixed p\, the partial derivative of U^(p\,pf) 



,2 (aj-gp t 

w.r.t. p\ in the neighboring of zero is a strictly decreasing function. The limit of the partial derivative of 
Ul(p\,Pi) when p\ tends to zero is given by 

1 i 



Vp|>0 , n m M^Bl.zJW <0 , 



where we used from g) the fact that /(0) = /'(0) = 0. 
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D. Proof of Proposition |6| 

Proof: We first remind that f("f)/p is maximized when p is such that 7 = 7* the positive solution of the 
equation xf'(x) = f(x). We thus have, for any 7i,p? > 

/(7*)/P* > f{ll)/pl (18) 
Replacing p* and p\ by their expressions resp. in (TTOb and (fTTl i in the above equation, we obtain 



. „ fir) > /(if) gfa-7iV) 

7* " 7? ffi(l+7*) 



V7i 2 >0, ^>^- ^ , ..1/ (19) 



Let us now proceed using reductio ad absurdum (proof by contradiction). Suppose that there exists a 7J* > 
solution of system (S) such that 7^* s]0, l/7*[- This is equivalent to suppose that at the equilibrium, there 
exists a feasible power p\* > (see Lemma ??). We make the observation that at the equilibrium, system (S) 
verifies that 

v 1 g 2 a-7*7n _ rhi) nm 

7l ' 51(1 + 7*) /'(7f)(l-7*7f) 
This is true for all 7-f, in particular for 7J =7*. Turning back to Eqt. ( fT9l ) and replacing the considered term 
at the right hand side by the latter term in d20l ) where we replace 7* by 7*, we get 

/(7*) fill*) r9n 



7*/'(r) " 7i 2 7'(7i 2 )(l-7? 7*) 

Knowing that (i) / is non-negative increasing function [4] and (ii) 7* is non-negative, we use a simple 
geometrical argument to show that, for all < 7^* < 1/7*, we have 

/(7*) /(7D m , 



7*/'(7*) 7i 2 7'(7i 2 )(l-7? 7*) 
which is in contradiction with Eqt. (f2TT> . This means that at the equilibrium the solution of system (S) is 
either negative or greater than or equal to 1/7* which is equivalent to the fact that p\* < 0. This implies that 
the unique feasible solution of system (S) is jf* = or equivalently p\* = 0. This completes the proof. ■ 

E. Proof of Proposition 

Proof: Over region A, we have the following relation between the powers of the leader on each carrier: 

-2 <D igjg2 , s fol-ga) 

ft - ft 2 1 + 2 1 

gfg2 gfg2 

We proved that maximizing the utility of the leader over region A implies maximizing this utility function by 
considering that p\ = 0. Then the previous condition becomes 

1 > ^(d-ai) ._ g-i 

Moreover, we know that the function Ul{p\,0) is maximized for p\ = ^— J— where 7* is the unique (positive) 

2 * 1 2 

solution of the first order Equation ((6]). It follows that if 2_JL_ > jji (i. e ., 2| > 1 _ ) then the utility of the 
leader over region A is maximized when p\ = a g J . Else, if ^pf- < p\ the utility of the leader is maximized 
when p\=p\. ■ 
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F. Proof of Proposition \8\ 

Proof: Over region B, we have the following relation between the powers of the leader on each carrier: 



v\>v\ 



1 „lfflff2 , 2 (92 - 92) 
,2„1 + „2„1 



9i92 9\92 

We proved that maximizing the utility of the leader over region B implies maximizing this utility function by 
considering that p\ = 0. Then the previous condition becomes 

2 > ^(9l-9\) ._ ~2 

Pi ^ n — ■— Pi- 

9192 

Moreover, we know that the function Ul(0,p1) is maximized for p\ = ^j- where 7* is the unique (positive) 
solution of the first order Equation ©. It follows that if ^-^j- > p\ (i-e-, |r < 1 + 7*) then the utility of the 



leader over region B is maximized when p\ = " ^ . Else if < p\ the utility of the leader is maximized 
when p\ =p\. 



